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Abstract — The problem of recovering a signal from its low 
frequency components occurs often in practical applications due 
to the lowpass behavior of many physical systems. Here we study 
in detail conditions under which a signal can be determined 
from its low-frequency content. We focus on signals in shift- 
invariant spaces generated by multiple generators. For these 
signals, we derive necessary conditions on the cutoff frequency of 
the lowpass filter as well as necessary and sufficient conditions 
on the generators such that signal recovery is possible. When 
the lowpass content is not sufficient to determine the signal, 
we propose appropriate pre-processing that can improve the 
reconstruction ability. In particular, we show that modulating 
the signal with one or more mixing functions prior to lowpass 
filtering, can ensure the recovery of the signal in many cases, 
and reduces the necessary bandwidth of the filter. 

Index Terms — Sampling, shift-invariant spaces, lowpass signals 



I. Introduction 

Lowpass filters are prevalent in biological, physical and 
engineering systems. In many scenarios, we do not have 
access to the entire frequency content of a signal we wish 
to process, but only to its low frequencies. For example, it 
is well known that parts of the visual system exhibit lowpass 
nature: the neurons of the outer retina have strong response 
to low frequency stimuli, due to the relatively slow response 
of the photoreceptors. Similar behavior is observed also in the 
cons and rods [1]. Another example is the lowpass nature of 
free space wave propagation [2]. This limits the resolution of 
optical image reconstruction to half the wave length. Many 
engineering systems introduce lowpass filtering as well. One 
reason is to allow subsequent sampling and digital signal 
processing at a low rate. 

Clearly if we have no prior knowledge on the original signal, 
and we are given a lowpassed version of it, then we cannot 
recover the missing frequency content. However, if we have 
prior knowledge on the signal structure then it may be possible 
to interpolate it from the given data. As an example, consider 
a signal x that lies in a shift-invariant (SI) space generated 
by a generator <j), so that x(t) = ^ a n <p(t — nT) for some 
T. Even if x is not bandlimited, it can be recovered from the 
output of a lowpass filter with cutoff frequency ir/T as long 
as the Fourier transform 4>(ui) of the generator is not zero for 
all lo G [-ir/T,n/T) [3], [4]. 

The goal of this paper is to study in more detail under what 
conditions a signal x can be recovered from its low-frequency 
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content. Our focus is on signals that lie in SI spaces, generated 
by multiple generators [5], [6], [7]. Following a detailed 
problem formulation in Section [TTJ we begin in Section [III] 
by deriving a necessary condition on the cutoff frequency 
of the low pass filter (LPF) and sufficient conditions on the 
generators such that x can be recovered from its lowpassed 
version. As expected, there are scenarios in which recovery 
is not possible. For example, if the bandwidth of the LPF 
is too small, or if one of the generators is zero over a 
certain frequency interval and all of its shifts with period 
2ir/T, then recovery cannot be obtained. For cases in which 
the recovery conditions are satisfied, we provide a concrete 
method to reconstruct x from the its lowpass frequency content 
in Section [TV] 

The next question we address is whether in cases in which 
the recovery conditions are not satisfied, we can improve our 
ability to determine the signal by appropriate pre-processing. 
In Section [V] we show that pre-processing with linear time- 
invariant (LTI) filters does not help, even if we allow for a bank 
of LTI filters. As an alternative, in Section |VI] we consider 
pre-processing by modulation. Specifically, the signal x is 
modulated by multiplying it with a periodic mixing function 
prior to lowpass filtering. We then derive conditions on the 
mixing function to ensure perfect recovery. As we show, a 
larger class of signals can be recovered this way. Moreover, 
by applying a bank of mixing functions, the necessary cutoff 
frequency in each channel can be reduced. In Section I VIII we 
briefly discuss how the results we developed can be applied 
to sampling sparse signals in SI spaces at rates lower than 
Nyquist. These ideas rely on the recently developed framework 
for analog compressed sensing [8], [9], [10]. In our setting, 
they translate to reducing the LPF bandwidth, or the number 
of modulators. Finally, Section I Villi summarizes and points 
out some open problems. 

Modulation architectures have been used previously in dif- 
ferent contexts of sampling. In [11] modulation was used 
in order to obtain high-rate sigma-delta converters. More 
recently, modulation has been used in order to sample sparse 
high bandwidth signals at low rates [12], [13]. Our specific 
choice of periodic functions is rooted in [13] in which a 
similar bank of modulators was used in order to sample 
multiband signals at sub-Nyquist rates. Here our focus is on 
signals in general SI spaces and our goal is to develop a 
broad framework that enables pre-processing such as to ensure 
perfect reconstruction. We treat signals that lie in a predefined 
subspace, in contrast to the union of subspaces assumption 
used in the context of sparse signal models. Our results can 
be used in practical systems that involve lowpass filtering to 
pre-process the signal so that all its content can be recovered 
from the received low-frequency signal (without requiring a 
sparse signal model). 
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II. Problem Formulation 

A. Notations 

We use the following notation: As usual, C N , L 2 , and 
£ 2 denote the TV-dimensional Euclidean space, the space of 
square integrable function on the real line, and the space of 
square summable sequences, respectively. All these spaces are 
Hilbert spaces with the usual inner products. Throughout the 
paper we write x for the Fourier transform of a function 
xeL 2 : 



X[0J) 



x(t) e~ iut dt, lj G 



The Paley-Wiener space of functions in L 2 that are bandlimited 
to [-B, B] will be denoted by PW{B): 

PW(B) — {x £ L 2 : x{uj) = for all uo £ [—B,B]}, 

and Pb is the orthogonal projection L 2 — > PW(B) onto 
PW(B). Clearly, Pg is a bounded linear operator on L 2 . 
We will also need the Paley-Wiener space of functions whose 
inverse Fourier transform is supported on a compact interval, 
i.e. 



PW{B) = {x G L 2 : x(t) = for all t 



-B,B}}. 
L 2 



For any a G R, the shift (or translation) operator S a 
L 2 is defined by (S a x)(t) — x(t — a). 

If {4>k}k£i is a set of functions in L 2 with an arbitrary 
index set X then span {<f>k : k G 1} denotes the closed linear 
subspace of L 2 spanned by {4>k}kex- 

B. Problem Formulation 

We consider the problem of recovering a signal x(t), t G R 
from its low-frequency content. Specifically, suppose that x is 
filtered by a LPF with cut off frequency tt/T c , as in Fig. Q] 
We would like to answer the following questions: 

• What signals x can be recovered from the output y of the 
LPF? 

« Can we perform preprocessing of x prior to filtering to 
ensure that x can be recovered from yl 



x(t) 

























— tt/T c n/T c 





y{t) 



Fig. 1. Lowpass filtering of x(t). 

Filtering a signal x G L 2 with a LPF with cutoff frequency 
7r/T c corresponds to a projection of x onto the Paley Wiener 
space PW(ir/T c ). Therefore we can write y = P n /<r c x. 

Note, that we assume here that the output y(t), t G R is 
analog. Since y is a lowpass signal, an equivalent formulation 
is to sample y with period T s = l/f s lower than the Nyquist 
period T c to obtain the sequence of samples {y[n\] ne z- The 
problem is then to recover x(t), f e I from the samples 
{?/W}nez, as in Fig. [2] Since {y[n]}„ e z uniquely determines 
y, the two formulations are equivalent. For concreteness, we 
focus here on the problem in which we are given y(t), t G R 



x(t) 





















— 7V 







V[n\ 



t = nT« 



Fig. 2. Sampling of x(t) after lowpass filtering. 



directly. Thus, our emphasis is not on the sampling rate, 
but rather on the information content in the lowpass regime, 
regardless of the sampling rate to follow. 

Clearly, if x is bandlimited to [— ir/T c , ir/T c ], then it can 
be recovered from y. However, we will assume here that x is 
a general SI signal, not necessarily bandlimited. These signals 
have the property that if x(t) lies in a given SI space, then so 
do all its shifts (SkTx)(t) = x(t — kT) by integer multiples 
of some given T. Bandlimited signals are a special class of 
SI signals. Indeed, if x is bandlimited then so are all its shifts 
SkTX, k G Z for a given T. In fact, bandlimited signals have an 
even stronger property that all their shifts S a x by any number 
a G R are bandlimited. Throughout, we assume that x lies in 
a generally complex SI space with multiple generators. 

Let (j) = {4>i, . . . , </>jv} be a given set of functions in L 2 
and let T G R be a given real number. Then the shift-invariant 
space generated by <\> is formally defined as [5], [6], [7]: 

&r(4>) = span {S kT 4> n ■ k G Z, 1 < n < N} . 

The functions <j) n are referred to as the generators of St{4>)- 
Thus, every function x G St{4>) can be written as 

N 

x{t) = ^^a n [k]<l) n {t-kT), teR, (1) 

n=l fceZ 

where for each 1 < n < N, {a n [k]}k<zz is an arbitrary 
sequence in £ 2 . Examples of such SI spaces include multiband 
signals [14] and spline functions [15], [3]. Expansions of the 
type (Q]i are also encountered in communication systems, when 
the analog signal is produced by pulse amplitude modulation. 

In order to guarantee a unique and stable representation 
of any signal in St{4>) by sequences of coefficients {a„[fc]}, 
the generators <f> are typically chosen to form a Riesz basis 
for 6>t (</>)■ This means that there exist constants a > and 
(3 < oo such that 

2 



a a 



< 



/v 



^^ an [£#„(i-fcT) 



n=l kel 
Ere=l Tlik 



<P\H 



(2) 



L 2 



where ||a|| a = J2n=i J2k£Z l a « M\ 2 - Condition © implies 
that any x G St(4>) has a unique and stable representation in 
terms of the sequences {a„[A:]}fc e z- In particular, it guarantees 
that the sequences {a„[/c]}fe e z can be recovered from x G 
St(4>) by means of a linear bounded operator. 

By taking Fourier transforms in (0 it can be shown that the 
generators (f> form a Riesz basi^] if and only if [6] 



al X M^w) ^ /3I, a.e.w6[-7r/T,7r/T]. 



(3) 



'Here and in the sequel, when we say that a set of generators <f> form (or 
generate) a basis, we mean that the basis functions are {<j>n(t — kT),k £ 
Z, 1 < n < N}. 
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Here M^(w) is called the Grammian of the generators 
{<fii, . . . , 4>n}, and is the N x N matrix 



M M 



(4) 



where for any two generators 
given by 



the function i?^ 



Note that the functions are 27r/T-periodic. Therefore, 

condition <£3j is equivalent to al < M^(w — a) -< j31. for every 
arbitrary real number a. We will need in particular the case 
a = tt/T, for which the entries of the matrix M^u — a) are 



(w - f ) = Yl - ^ 2k + !] f ) " t 2fc + !] f )■ 

(6) 



fcez 



III. Recovery Conditions 

The first question we address is whether we can recover 
x G St{4>) of the form (Q~|i from the output y = P^/t^ a; of a 
LPF with cutoff frequency tt/T c , assuming that the generators 
<fi satisfy J3). We further assume that the generators are not 
bandlimited to tt/T c , namely that they have energy outside the 
frequency interval [— ir/T c , 7r/T c ]. We will provide conditions 
on the generators <j> and on the bandwidth of the LPF such that 
x can be recovered from y. As we show, even if the generators 
<fi are not bandlimited, x can often be determined from y. 

First we note that in order to recover x G <St(</>) from 
the lowpass signal y = P- k /t c x it is sufficient to recover the 
sequences {a n [k]}kez, 1 < n < N because the generators 
<fi are assumed to be known. The output of the LPF can be 
written as 

N 

y(t) = {P„ /Tc x)(t) = X) S ^ _ fcT) 

n=l fceZ 

where ip n := P^/t c 'fin denotes the lowpass filtered generator 
<fi n , and the sum on the right-hand side converges in L 2 
since Ptt/t c is bounded. Therefore, we immediately have the 
following observation: The sequences {a n [k]}k£Z, 1 < n < N 
can be recovered from y if ift forms a Riesz basis for 5r(V0- 
This is equivalent to the following statement. 

Proposition 1: Let <fi = {<fii, . . . , /fix} be a set generators, 
and let ip n = P- K jT c ( fin, 1 < n < N be the lowpass filtered 
generators where ir/T c is the bandwidth of the LPF. Then 
the signal x G Sr((fi) can be recovered from the observations 
y = P^/ Tc x if the Grammian M^,(o)) satisfies (01 for some 
< a < (3 < oo. 

Example 1: We consider the case of one generator (N = 1) 



o, 



t G [-D,D] 
t$[-D,D] 



(7) 



for some D > 0. The Fourier transform of this generator is 
4>i(u>) — sin(uiD)/(uiD) which becomes zero at uj = ktr/D 
for all k = ±1, ±2, .... We assume that D/T is not an integer. 



Then one can easily see that this generator satisfies ©, i.e. 
there exists a, (3 such that 

2 



< a < 



sm(uiD - 2-KkDjT) 



ujD - 2nkD/T 



< /3 < oo 



(8) 



for all uj G [—tt/T, tt/T]. The lower bound follows from the 
assumption that D /T is not an integer, so that all the functions 
in the above sum have no common zero in [—tt/T, tt/T]. The 
upper bound (3 follows from 



E 

fcez 



sin(wZ) - 2-KkD/T) 



luD - 2nkD/T 



< 



feez 



< 



T 

'tTd 



\ojD 
1 



2irkD/T\ i 



^ (2k 

fe=i v 



1 



< 



2T 



using that \wD- 2TrkD/T\ > TrD/T(2\k\ - 1) for all k = 
±1, ±2, . . . and all uj G [-tt/T, tt/T]. 

Assume now that the LPF has cutoff frequency tt/T c = 
tt/T. Then the Fourier transform tfii of the filtered generator 
ifii — Pn/T 4>i w iH satisfy a relation like (O only if D < T, 
i.e. only if cfii has no zero in [— tt/T, tt/T]. In cases where 
D > T the cutoff frequency has to be larger in order to allow a 
recovery of the original signal. One easily sees that the cutoff 
frequency of the LPF has to lie at least tt/T — tt/D above 
tt/T in order that x/ji will satisfy a relation similar to (0. In 
this case, the shifts ifii(uj ± 2tt/T) compensate for the zero 
of ifii(uj) in the sum ((H). Thus for cutoff frequencies tt/T c > 
2tt/T — tt/D a recovery of the signal x from the LPF signal 
y will be possible. 

The previous example illustrates that the question whether ip 
forms a Riesz basis for 5t(V0 depends on the given generators 
<fi and on the bandwidth tt/T c of the LPF. The next proposition 
derives a necessary condition on the required bandwidth tt/T c 
of the LPF such that ifi can be a Riesz basis for St{iP)- 

Proposition 2: Let <fi — {<fii, . . . , (fix} be a Riesz basis for 
the space St(4>) and let ifi n = P- !r /T c <fin with 1 < n < N. 
Then a necessary condition for ifi = {ifii, ...,iprsr} to be a 
Riesz basis for S T (V0 is that tt/T c > Ntt/T. 

Proof: We consider the Grammian My,(tj) whose entries 
are equal to 



^(W)= J2 ^-k^)^J 3 {uj-k^r). 

I*l<i(£+1) 

All other terms in the generally infinite sum (cf. Q) are 
identically zero since ifinipj) is bandlimited to [— tt/T c , tt/T c ]. 
This Grammian can be written as M^w) = \&* (w)* (w) with 



V-i(w) 



ik{u-[Lo + l]U) 



VSjv(w) 



^jv(^- [Lo + 1]^) 



(9) 
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where Lq is the largest integer such that Lq < {T/T c — l)/2. 
Since every ip n (oj) is banded to [—ir/T c ,ir/T c ], the first and 
the last row of this matrix are identically zero for some u> G 
[— tt/T, tt/T], At these u's, the matrix ^f(uj) has effectively 
L = 2Lq + 1 rows and N columns, and it holds that L < T/T c . 
Since M^(w) = ^*(lu)^(uj), the Grammian can have full 
rank for every 10 G [— tt/T, tt/T] only if L > N, i.e. only if 
n/T c > Ntt/T. ■ 

The necessary condition on the bandwidth of the LPF 
given in the previous proposition is not sufficient, in gen- 
eral. However, given a bandwidth ir/T c which satisfies the 
necessary condition of Proposition [2] sufficient conditions on 
the generators <p can be derived such that the lowpass filtered 
generators i/j form a Riesz basis for St(iP), i.e. such that x 
can be recovered from y. 

Proposition 3: Let <j) — {<pi, . . . ,4>n} be a Riesz basis for 
S T ((f>) and let ip n = P v / Tc 4>n for 1 < n < N with tt/T c > 
Ntt/T. Denote by L the largest integer such that L < T/T c . 
If L = 2Lq + 1 is an odd number, then we define the L x N 
matrix by 



0i(w + 2L o f) 
&(w + 2f) 

For L = 2Lq even, we define 

0i(w + [2L o -l]f) ... 
0i(w + f) 

0i(w-[2L o -l]S) ••• 



^(w + 2L f) 

^ JV (w + 2f) 

0/vM 
0jv(w-2f) 

0Ar(^ - 2i f ) 



(10) 



'TV 



(w + [2Lo-l]f) 

07v(w - f ) 

( w _[2Lo-l]f) 



(11) 



If there exists a constant a > such that 



M i (w):=$^(w)$ £ (u)bal a.e. w G , f ] (12) 

then %jj = {ipi, . . . , i^n} forms a Riesz basis for St(iP)- 

Moreover, if T/T c is an integer, then condition (fT2l is also 
necessary for ip to be a Riesz basis for St{iP)- 

When 7r/T c — » oo, i.e. L — > oo, the matrix Mi(w) reduces 
to M^cj) of ©, which by definition satisfies OJ. However, 
since for the calculation of the entries of Ml(cj) we are only 
summing over a partial set of the integers, we are no longer 
guaranteed that Mj,(w) satisfies the lower bound of 

The requirements of Proposition [3] imply that L > N. 
Consequently, the matrix Mj,(u) = $>* L (tu) is positive 

definite for almost all to G [—tt/T, tt/T] if and only if 3>l(u;) 
has full column rank for almost all uo G [— tt/T, tt/T]. 



Note that Example [T] shows that (TTZb is not necessary, in 
general: With T < D < 2T and a cutoff frequency of 
tt/T c > 2tt/T — tt/D, the corresponding ip form a Riesz basis 
for St(4>)- However, it can easily be verified that ( fT2l is not 
satisfied. 

Proof: We consider the case of L being odd. It has 
to be shown that the Grammian M v >(w) satisfies ([3). Since 
NT C < T, the Grammian can be written as M v >(tj) = 
**(w)*(a/) with defined by ©. Next *(ci>) is written 

as = *l(cj) + , 4'_l(w) where is the (2£ + l) x 

N matrix whose first and last row coincide with those of ^(u) 
and whose other rows are identically zero. Similarly S&l(w) 
denotes the matrix whose first and last row is identically zero 
and whose remaining rows coincide with those of *S?(ui). Since 
ip n (uj) = n (w) for all u> G [— tt/T c , tt/T c ] and for every 
1 < n < N, we have that *£(u>) *zM = *!M*lM- 
Therefore, 



M^(w) = + *1(cj) 

= #i(w)* L (o;) + *l(w)*xH (13) 



since by the definition of ^^(a;) and \& 



we obviously 



have that *J-M = and = 0. Now 

it follows from ( fT3l that for every x G 



x* M v ,(w)x 



> 



|#z(w)x||£* 
|*z(w)x| 



|*l(w)x||£* 



=x* *£H* L (u;)x > a, 



where the last inequality follows from (fT2l . This shows that the 
Grammian (w) is lower bounded as in (01. The existence 
of an upper bound for M^(tj) is trivial since M^,(w) has finite 
dimensions. 

Assume now that T/T c is an (odd) integer. In this case 
Lq = (T/T c — l)/2 and it can easily be verified that the 
matrix *S?j_(uj) is identically zero. From ( fT3l . M^,(w) = 
$2(w) = Ml(w) which shows that if the Grammian 

M^(tj) satisfies (fJJ then satisfies (1121 1. This proves that 

(fT2l is also necessary for -0 to be a Riesz basis for St(i/>). 

The case of L even follows from the same arguments but 
starting with expression © for the entries of the Grammian 
instead of (0. Therefore, the details are omitted. ■ 

Example 2: We consider an example with two generators 
(N=2) which both have the form as in Example Q] with 
different values for D, i.e. 



i(t) 



1/(2A 
0, 



t g [- A, A] 
ti [-A, A] 



i = 1,2 



with Fourier transforms 4>i(ui) = sin(wA)/( w A)- As in 
Example Q] we assume that Di/T are not integers and that 
A 7^ A- Under these conditions, the Grammian \L(w) 
of (/> = {01,02} satisfies ©. To see this, we consider the 
determinant of M^(w) for some arbitrary but fixed to G 
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-7T/T, tt/T]: 
det[M (w)] 




E 

feGZ 



U2n- 

K rp 



(j)i{u - k4f) 4> 2 (uj 




(14) 



We know from Example Q] that the first term on the right hand 
side is lower bounded by some constant ai«2 > 0. Moreover, 
the Cauchy-Schwarz inequality shows that the second term on 
the right-hand side is always smaller or equal than the first 
term with equality only if the two sequences 



1,2 



are linearly dependent. However, since D% ^ D2, it is not hard 
to verify that these two sequences are linearly independent. 
Consequently det[M^(o;)] > for all u E [-tt/T, tt/T} 
which shows that M^(w) satisfies the lower bound of (01. That 
M^fw) satisfies also the upper bound in (O follows from a 
similar calculation as in Example[T]using that deceases 
proportional to 1/cj as |cj| — ► 00. 

Assume now that the bandwidth of the LPF satisfies 
2-k/T < tt/T c < 3tt/T. In this case the matrix of 
Proposition [3] is given by 



and the determinant of Mx,(w) := becomes 



det[Mi(w)]= ^ |&(w-kf)| |&(w-fc£) 
fc=±i 



fc=±i 



0i(w-fcf)^a(w-fcf) 



(15) 



This expression is similar to (TT4l and the same arguments show 
that det[M L (w)] > for all u E [~n/T, tt/T}. Namely, since 
Di/T are not integers, the functions ^(lu + tt/T) and 4>i(uJ — 
tt/T) have no common zero such that the first term on the 
right hand side of (Q3) is lower bounded by some ol\Ui > 0. 
The Cauchy-Schwarz inequality implies that the second term 
is always smaller than the first one. 

We conclude that $>l(uj) satisfies the condition of Propo- 
sition [3] so that the signal x can be recovered from its low 
frequency components y = P n /x c x. 

If for a certain bandwidth tt/T c of the LPF the generators 
4> satisfy the conditions of Proposition [3] then the signal x can 
be recovered from y = P^/t c x. However, if the generators 4> 
do not satisfy these conditions, then there exists in principle 
two ways to enable recovery of x: 

• Increasing the bandwidth of the LPF. 

> Pre-process x before lowpass filtering, i.e. modify the 
generators <j>. 

It is clear that for a given set = {<fii, . . . (j)^} of generators 
an increase of the LPF can only increase the "likelihood" that 
the matrix &l(ui) of Proposition [3] will have full column rank. 
This is because enlarging tt/T c increases the number L i.e. it 



adds additional rows to the matrix which can only enlarge the 
column rank of $l(uj). Pre-processing of x will be discussed 
in detail in Sections [V] and [VI] 

IV. Recovery Algorithm 

We now describe a simple method to reconstruct the desired 
signal x from its low frequency components. This method 
is used in later sections to show how pre-processing of the 
signal x may facilitate its recovery. Throughout this section, 
we assume that the bandwidth tt/T c of the LPF satisfies the 
necessary condition of Proposition [2] and that the generators 
satisfy the sufficient condition of Proposition [3] 

Taking the Fourier transform of ([T}, we see that every x E 
St{4>) can be expressed in the Fourier domain as 



N 



i(Lj) = Y,a n (e juT )j> n (u), ojE 



(16) 



71=1 



where 



A-e: 



is the 27r/T-periodic discrete time Fourier transform of the 
sequence {a n [k}}k£z at frequency wT. Denoting by a(e : '" T ) 
the vector whose nth element is equal to a n {&' ulT ) and by 
4>(uo) the vector whose nth element is equal to (p n (u>) we can 
write ( TTSI l in vector form as 

x(lu) =</> T (w)a(e^ T ). 

The Fourier transform of the LPF output y = Ptt/t c x is 
bandlimited to tt/T c , and for all uj E [—tt/T c ,tt/T c } we have 
y(u>) = x(u>). Therefore 

y(oj) = 4> T (uj)a(e^ T ), w e [-£, £]. (17) 

For every uj E [—tt/T c ,tt/T c }, (ITTb describes an equation 
for the N unknowns a n (e : > u}T ). Clearly, one equation is not 
sufficient to recover the length- N vector a(e JwT ); we need at 
least N equations. However, since according to Proposition [2] 
the bandwidth of the LPF has to be at least tt/T c > Ntt/T, we 
can form more equations from the given data by noting that 
a is periodic with period 2tt/T, while <p, and consequently 
y, are generally not. Specifically, let ujq E [—tt/T, tt/T} be 
an arbitrary frequency. For any ojk — + 2irk/T with k 
an integer we have that a(e jajfcT ) = a(e J "° T ). Therefore, by 
evaluating y and <p at frequencies —tt/T c < u>k < tt/T c , we 
can use (l% to generate more equations. To this end, let L 
be the largest integer for which L < T/T c . Assume first that 
L = 2Lq + 1 for some integer Lq, so that L is odd. We then 
generate the equations 



k^ 



) = (j> n (u - k ^) a n (uj 



k^ 



for —Lq < k < L and for lu E [-tt/T, tt/T}. Since by 
our assumption tt/T c > Ltt/T, all the observations j)k(u) — 
y(oj — 2k tt/T) are in the passband regime of the LPF. The 
above set of L equations may be written as 

* L Ha(e^ T ), w E [—tt/T, tt/T}, 



(18) 
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where y(w) = [y_ Lo (w), . . . , 0, . . . , j/L D (w)] T is a length L 
vector containing all the different observations jjk of the output 
y, and 3?i(w) is the L x N matrix given by ( fTOb . In the case 
where i = 2Lq is an even numbeQ we generate additional 
equations by 



2/fc(w) 



N 

£ 

n=l 



0„(w-[2fc + l]*)a n (w-[2/c + l]f) (19) 



for — Lo < fc < — 1- Here again all the observations in 
(fT9l are in the passband regime of the LPF. Therefore, (TT9l 
can be written as in ([T8T > where 3>£(w) is now given by ( fTTT i, 
and the definition of a is changed accordingly. 

If the matrix 3?i,(w) satisfies the sufficient conditions of 
Proposition [3] then the unknown vector k(e : > ujT ) can be 
recovered from (TT~8T > by solving the linear set of equations for 
all lo G [— 7r/T, 7r/T]. In particular, there exists a left inverse 
G(w) of * L (w) such that a(e^ T ) = G(w) y(w). Finally, the 
desired sequences {a„[fc]}fcGZ are the Fourier coefficients of 
the 2tt/T periodic functions a n . 

V. Preprocessing With Filters 

When $>l(lo) does not has full column rank for all lo £ 
[— 7r/T, 7t/T] and if the bandwidth of the LPF can not be 
increased, an interesting question is whether we can pre- 
process x before lowpass filtering in order to ensure that it 
can be recovered from the LPF output. In this and in the 
next section we consider two types of pre-processing: using 
a bank of filters, and using a bank of mixers (modulators), 
respectively. 

Suppose we allow pre-processing of x with a set of N filters, 
as in Fig. [3] The question is whether we can choose the filters 
g n in the figure so that x can be recovered from the outputs 
y n of each of the branches under more mild conditions than 
those developed in Section [III] 



x(t) 



9i(t) 











-7T/T C 


7T/T C 



yi(t) 



9N(t) 











-7T/T C 


7T/T C 



VN(t) 



Fig. 3. Preprocessing of x(t) by a bank of N LTI filters. 

Let y, g be the length- N vectors with nth elements given 
by y n ,gn- Then we can immediately verify that 



(20) 



Clearly, a cannot be recovered from this set of equations as 
all the equations are linearly dependent (they are all multiples 

2 In subsequent sections, we will only discuss the case where L is odd. The 
necessary changes for the case of L being even are obvious. 



of each other). Thus, although we have N equations, only 
one of them provides independent information on a. We can, 
as before, use the periodicity of a if T c is small enough. 
Following the same reasoning as in Section [IV] assuming 
that 7r/T c > Ltt/T, we can create L — 1 new measurements 
using the same unknowns a by considering y(oo) for different 
frequencies lo + k2n/T. In this case though it is obvious that 
the pre-filtering does not help, since only one equation can 
be used from the set of N equations (f20b for each frequency. 
In other words, all the branches in Fig. [3] provide the same 
information. The resulting equation is the same as in the 
previous section up to multiplication by <?„ for one index 
1 < n < N. Therefore, the recovery conditions reduce to 
the same ones as before, and having N branches does not 
improve our ability to recover x. 

VI. Preprocessing With Mixers 

We now consider a different approach, which as we will 
see leads to greater benefit. In this strategy, instead of using 
filters in each branch, we use periodic mixing functions p n . 
Each sequence is assumed to be periodic with period equal 
tc0 T p = T. By choosing the mixing functions appropriately, 
we can increase the class of functions that can be recovered 
from the lowpass filtered outputs. 

A. Single Channel 

Let us begin with the case of a single mixing function, as 
in Fig. H] Since p is assumed to be periodic with period T, it 



x(t) 



) — ► 


















— 7T 


/T c 7T/T C 





y(t) 



p(t) 



Fig. 4. Mixing prior to lowpass filtering of x(t). 

can be written as a Fourier series 



(21) 



where 



h = i p(t) e-^ kt ' T dt , k G Z (22) 

1 J-T/2 

are the Fourier coefficients of p. The sum ( f2TT > is assumed to 
converge in L 2 which implies that the sequence {bk}k£Z is an 
element of £ 2 . The output y = P 7r ^ Ta (px) of the LPF is then 
given in the frequency domain by 

J(w) = ^6 t i(«-fc|), we [-£,£]. (23) 

fcez 

Using ( [16] ) and the fact that a n (e JujT ) is 27r/T-periodic, 
can be written as 



(lo) = ««(^ T ) J2 bk ^ - fc ^)' (24) 



3 Note, that we can also choose T p = T/r for an integer r. However, for 
simplicity we restrict attention to the case r = 1. 
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for uj e [-tt/T c ,tt/T c ]. Defining 

%(u) :=J2 b Mu-k%-), l<n<N (25) 

fcez 

and denoting by 7 the vector whose nth element is j n , we 
can express d24l > as 

j( W ) = 7 T Ha( e ^), wG [-£,£]. 



(26) 



Equation (126b is similar to ( fTTI i with 7 replacing 0. There- 
fore, as in the case in which no pre-processing took place 
(cf. Section UVb , we can create L — 1 additional equations 
by evaluating y(uo) at frequencies u> + 2kir/T as long as 
7r/T c > Lir/T. This yields the system of equations 

yH=r L Ha(e^ T ), wg| 

where y and a are defined as in ( TTOb and 



7T 7T 1 

" T ' T J ' 



(27) 



71 (cj) 



7jv(w) 



7i(w-i ^) ... ^(w - i f ) 



Consequently, we can recover a from the given measurements 
as long as the matrix Tl(lu) has full column rank for all lu G 
[— 7r/T, 7r/T]. To this end it is necessary that tt/T c > Ntt/T, 
i.e. that L > N. 

Due to the mixing of the signal, the coefficient matrix 
in ( TT~8T > is changed to T^cj) in 1271 . This new 
coefficient matrix is constructed out of the "new generators" 
{ln}n=\ m exactly the same way as is constructed 

from the original generators {4> n }n=i- Equation (l25T l shows 
that the Fourier transform j n of each new generator lies in a 
shift invariant space 



S2 



spanj^a^ <p n : k S Z} 



spanned by shifts of <73„. The coefficients {bk}k£Z of the 
mixing sequence are then the "coordinates" of 7„ in (</>„). 

We now want to show that the condition of invertibility 
of Tl(lu) is in general easier to satisfy then the analogous 
condition on the matrix <J?l(w) of (TTOb . To this end, we write 
T l (lu) as 

r L (w) = B L #(w), (28) 
where denotes the matrix consisting of iV columns and 

» T 

infinitely many rows <p (lu + k2n/T) with k G Z. Note that 
has the form dTot with L — > 00, i.e. = •^(w). 

The matrix with L = 2Lq + 1 rows and infinite columns 
contains the Fourier coefficients {bk}k£Z of the mixing se- 
quence (fJTJ and is given by 





" •■■ b£ -i 












&1 






B L = 


... 6_x 


&0 


6l 


■ (29) 




6-2 


6-1 










6 -io 


6-L + l ■ ■ • . 





Representation (l28l follows immediately from the relation 
7„(w - £2tt/T) = Y,kei, b k-^n(^ - k^f) for the entries 
of the matrix T^(lu). 

The Grammian M^oj) of the generators <fi, defined in (0), 
can be written as M^w) = <&*(w)<fr(w). Therefore, under our 
assumption (01 on the generators, <fr(w) has full column rank 
for all w G [— tt/T, 7r/T]. The question then is whether we 
can choose the sequence {&fc}fcez S and consequently the 
function p, so that B^ $(cj) has full-column rank i.e. such that 
the matrix T* l (lu)T l (uj) = ** (lu)B* l B l ^{lu) is invertible 
for all lu G [-tt/T, tt/T]. 

If we choose the mixing sequence p(t) = 1 then bo = 1 and 
&fc = for all k ^ 0. Consequently Bi$(w) is comprised of 
the first L rows of 3>(w), so that Tl(lu) = &l(lu). However, 
by allowing for general sequences {6fc}fcez, we have more 
freedom in choosing B^ such that the product B^ <fr(cj) may 
have full column-rank, even if $>l(lo) does not. 

We next give a simple example which demonstrates that 
pre-processing by an appropriate mixing function can enable 
the recovery of the signal. 

Example 3: We continue Example [T] with the single gen- 
erator (j>x given by ([TJi. Here we assume that the parameter 
D satisfies the relation 1 < D/T < 3/2 and that the cutoff 
frequency of the lowpass filter is tt/T c = tt/T. In this case, 
recovery of x from its lowpass component y = P^/ Tc x is not 
possible, as discussed in Example Q] However, we will show 
that there exist mixing functions p so that x can be recovered 
from y = P n/Tc (px). 

One possible mixing function is 

p(t) =1 + 2 sin(27rf/T) 

whose Fourier coefficients d2"2i i are given by 6_i = —j, 60 = 
1, 61 = j, and b k — for all |fc| > 2. With this choice, the 
"new generator" d25l l becomes 



7i M = 



sin(u)D) 



+ J 



luD 

sin(o;-D 



2irD /T) sm(u>D + 2ttD/T) 



luD - 2nD/T uuD + 2nD/T 

Since tt/T c = tt/T, the matrix Tl(uj) reduces to the scalar 
7i(w) and we have to show that < |7i(w)| < 00 for all 
lu G [—tt/T, tt/T}. The upper bound is trivial; for the lower 
bound, it is sufficient to show that the real and imaginary 
part of 7x have no common zero in [— tt/T, tt/T]. This fact is 
easily verified by noticing that the only zeros of the real part 
of 71 (lu) are at lu\ = tt/D and u>2 = —tt/D. Evaluating the 
imaginary part 3{7i} of 71 at these zeros gives 

lf x. r - / mi 1 |sin(27rD/T)| 

which is non-zero under the assumption made on D/T. 

The general question whether for a given set <f> = 
{</>!,..., cf) n} of generators there exists a matrix B^ such 
that (f28l) is invertible for all w G [-tt/T, tt/T], or under 
what conditions on the generators cf) such a matrix can be 
found seems to be an open and non-trivial question. The major 
difficulty is that according to (1281 . we look for a constant 
(independent of lu) matrix Bl such that Bi$(w) has full 
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column rank for all lo £ [—ir/T,%/T]. Moreover, the matrix 
Bi has to be of the particular form (f29) with a sequence 

{b k } k & 6 I 2 . 

The next example characterizes a class of generators for 
which a simple (trivial) mixing sequence always exist. 

Example 4 (generators with compact support): We 
consider the case of a single generator (N = 1) and 
assume that ir/T c = tt/T, i.e. L = N = 1. Our problem 
then reduces to finding a function 71 £ (<jf>i ) such that 
71H ^ for all u e [-vr/T, tt/T]. 

We treat the special case of a generator <f>i with finite 
support of the form [-D, D] for some D EM., i.e. we assume 
that </>i(<) = for all t ^ [-D, D], This means that its Fourier 
transform <f>\ is an element of the Paley- Wiener space PW(D) 
and so are all linear combinations of the shifts SW/t^i- It 
follows that 5(0i) C PW(D). 

Let now 7 6 <->(</>i) be arbitrary and let {w/cjfcez be the 
ordered sequence of real zeros of 7 with uo n < w n +i. Then a 
theorem of Walker [16] states that 



sup \LO, n 



> tt/D. 



Thus there exists at least one interval of the real line of length 
tt/D such that 7 has no zeros in this interval. Consequently, 
if tt/D > Air/T then there always exists a fcp £ Z such that 



7 (cj-fc f^0 for all w € [-f ,§]. 



(30) 



This holds in particular for the generator 4>i itself. 

We conclude that if the support of the generator <pi satisfies 
supp(^i) < T/4, then there always exists a ko E Z such that 
= 4>i(uj - k 2ir/T) ^ for all lo 6 [-tt/T, tt/T]. 
The corresponding mixing sequence is given by bk = 1 and 
bk = for all k ^ ko- 

B. Multiple Channels 

In the single channel case, it was necessary that the cutoff 
frequency ir/T c of the LPF is at least N times larger than the 
bandwidth of the desired signal a in order to be able to recover 
the signal. We will now show that using several channels can 
reduce the cutoff frequency ir/T c of the filter in each channel, 
from which we can still recover the original signal x. 

Suppose that we have L > N channels, where each channel 
uses a different mixing sequence, as in Fig. [5] Since L > N, 
we expect to be able to reduce the cutoff in each channel. 
We therefore consider the case in which T c = T. The output 
ye = P„/x{pix) of the £th channel in the frequency domain 
is then equal to 

w( W )= 7 [( W )a(^ T ), ^ 

where jJ(lu) is the vector with nth element 

fi t (w)] n = rt(u>) :=£ + 
feez 

and {bf,}k£Z are the Fourier coefficients associated with the 
£th sequence p#. Defining by y(w) the vector with £th element 
ye(co) we conclude that 

y(w)=r i (w)a(e''« T ) 



it) 



) — - 


















—IT 


/T c n/T c 





1/1 (t) 



Pl(t) 



) — - 


















—IT 


/T c n/T c 





y L (t) 



PL® 



Fig. 5. Bank of mixing functions. 



where Tl(u>) is the matrix whose entry in the £th row and 
nth column is [T(c<;)]^ „ = 7^(i^). Now, all we need is to 
choose the L sequences {6^.}fcez G I 2 such that T l (uj) has 
full column rank. More specifically, as before we can write 



r L (w) = b l *(w), 



(31) 



where is a matrix with L rows and infinitely many columns 
whose Mi row is given by the coefficient sequence {b £ k }k£i„ 
i.e. 



>L = 



bU 



b 2 -, 



b\ 



h L 



b\ 
bl 



b\ 
bl 



b L 
"2 



7T 7T 1 



By our assumption <&(u;) has full column rank and so it 
remains to choose B^ such that Tl(uj) is invertible for every 
U E [-tt/T, tt/T]. 

It should be noted that we used the same notation as in the 
previous subsection although the definition of the particular 
matrices and vectors differ slightly in both cases. Nevertheless, 
the formal approach is very similar. In the previous subsection, 
we observed the output signal in different frequency channels 
1 < f < L whereas in this subsection the channels 1 < £ < L 
are characterized by different mixing sequence^ 

As in the previous subsection, the general question whether 
for a given system <f> — {<pi, . . . ,</)n} of generators there 
always exists an appropriate system of mixing sequences 
p = {pi, . . . ,pl} such that Tl{uS) has full column rank for 
all frequencies lo seems to be non-trivial. The formal difficulty 
lies in the fact that we look for a constant (independent of 
uf) matrix B^ such that (l3TT l has full column rank for each 
lo G [—tt/T, tt/T}. However, compared with the previous 
section, where only one mixing sequence was applied, the 
problem of finding an appropriate matrix B^ becomes simpler: 
In the former case B/, has to have the special (diagonal) 
form d29l >, whereas here its entries can be chosen (almost) 
arbitrarily. The sequences {b e k }k£Z only have to be in £ 2 . 

A special choice of periodic functions that are easy to 
implement in practice are binary sequences. This example was 

4 In the first case we perform "frequency multiplexing" whereas the second 
case resembles "code multiplexing". 
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studied in [13] in the context of sparse multiband sampling. 
More specifically, pi, 1 < i < L are chosen to attain the 
values ±1 over intervals of length T/M where M is a given 
integer. Formally, 

Pi (t)=ai, <t < (n + l)-j£, < n < M - 1 (32) 

with a £ n € {+1, -1}, and pi(t + kT) = pi{t) for every k G Z. 
In this case, we have 



61 = 



1 

ry 



7^: 



M-l 



T 5^ 



n=0 

Evaluating the integral gives 
i»o = i«n and bl = 



T/M 



M " K j27Tfc 

where cjo = 2n/M, and {a £ k }k£Z denotes the discrete 
Fourier transform (DFT) of the sequence {c^I^Jq 1 . Note that 
{afejfcez is -periodic so that a k = & k +M- 

With these mixing sequences, the infinite matrix can be 
written as 

B L = QF*W, (33) 

where Q is a matrix with M columns and L rows, whose Mi 
row is given by the sequence {a^^JT^, F is the M x M 
Fourier matrix, and W is a matrix with M rows and infinitely 
many columns consisting of block diagonal matrices of size 
M x M whose diagonal values are given by the sequence 
{w k }kez defined by w = 1/M and w k = 1 ~j 2 ^° for 
k ^ 0. Applying these binary mixing sequences, the problem 
is now to find a finite LxN matrix Q with values in {+1, —1} 
such that QF*W$(w) has full column rank for every to G 
[-n/T, n/T]. 

The next example shows how to select Q in the case of 
bandlimited generators. 

Example 5 (bandlimited generators): We consider the case 
where each generator <f> n is bandlimited to the interval 
[-K n/T, K n/T] for some K e N, and TV = 2K + 1. In 
this case, &(uj) = $n(uj) is essentially an TV x TV matrix (all 
other entries are identically zero). This matrix is invertible for 
every u> G [— n/T, n/T] according to assumption (fjjl. 

We now apply L = N different mixing sequences {pi}f =1 
having the special structure (132b . and choose M = TV. 
According to PTT ) and ( f33l> the matrix Tl(lj) then becomes 



&i, k^Q 



r L {uj) = QF*W*(cj), 



(34) 



where Q F* and W$(lj) are matrices of size N x N. The 
matrix W$(tj) may be considered as the product of the 
invertible N x N matrix <&(w) = <frjv(u;) with an V x TV 
diagonal matrix consisting of the central diagonal matrix of 
W, i.e. 

W*(w) =diag(w ,...,ii?jv-i)*ivM- 



Since this diagonal matrix is invertible also W€»Ar(tj) is 
invertible for every to G [— n/T, n/T], Therefore, using the 
fact that the Fourier matrix F is invertible, r^(w) is invertible 
for each uj e [-n/T, n/T] if the values {a e n }% =1 of the 
mixing sequences pi are chosen such that Q is invertible. This 
can be achieved by choosing Q as a Hadamard matrix of order 
V. It is known that Hadamard matrices exists at least for all 
orders up to 667 [17]. 

In the previous example, ^^(uS) was an V x TV invertible 
matrix for all ui G [— n/T, n/T]. According to Proposition [3] 
recovery of the signal x is therefore possible if the bandwidth 
of the LPF is larger than Nn/T. However, the example shows 
that pre-processing of x by applying the binary sequences in 
L = N channels allows recovery of the signal already from 
its signal components in the frequency range [—n/T, n/T]. 

For simplicity of the exposition, we assumed throughout 
this subsection that the bandwidth 2n/T c of the lowpass filter 
is equal to the signal bandwidth 2n/T and that the number 
of channels L is at least equal to the number of generators 
V. However, it is clear from the first subsection that in cases 
where L < N, recovery of the signal may still be possible if 
the bandwidth of the LPF is increased. 

VII. Connection with Sparse Analog Signals 

In this section we depart from the subspace assumption 
which prevailed until now. Instead, we would like to incor- 
porate sparsity into the signal model x(t) of (UJ. To this end, 
we follow the model proposed in [9] to describe sparsity of 
analog signals in SI spaces. Specifically, we assume that only 
K out of the generators 4> n (t) are active, so that at most K 
of the sequences a n [k] have positive energy. 

In [9], it was shown how such signals can be sampled 
and reconstructed from samples at a low rate of 2K/T. The 
samples are obtained by pre-processing the signal x(t) with 
a set of 2K sampling filters, whose outputs are uniformly 
sampled at a rate of 1/T. Without the sparsity assumption, at 
least V sampling filters are needed where generally V is much 
larger than K. In contrast to this setup, here we are constrained 
to sample at the output of a LPF with given bandwidth. Thus, 
we no longer have the freedom to choose the sampling filters 
as we wish. Nonetheless, by exploiting the sparsity of the 
signal we expect to be able to reduce the bandwidth needed 
to recover x{t) of the form (Q~|i, or in turn, to reduce the number 
of branches needed when using a bank of modulators. 

We have seen that the ability to recover x (t) depends 
on the left invertibility of the matrix $l(^) (or Tl{uj)). 
With appropriate definitions, our problem becomes that of 
recovering k(e^ uT ) from the linear set of equations (fT8T l (with 
Tl(lu) replacing $l(^) when preprocessing is used). Our 
definition of analog sparsity implies that at most K of the 
Fourier transforms a n {uj) have non-zero energy. Therefore, 



the infinite set of vectors {a(. 



uj G [-n/T, n/T]} share 



a joint sparsity pattern with at most K rows that are not zero. 
This in turn allows us to recover {^.(e- 7 ^ 11 ), uj G [—n/T, n/T]} 
from fewer measurements. Under appropriate conditions, it is 
sufficient that y(oj) has length 27i", which in general is much 
smaller than V. Thus, fewer measurements are needed with 
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respect to the full model ([]]). The reduction in the number of 
measurements corresponds to choosing a smaller bandwidth 
of the LPF, or reducing the number of modulators. 

In order to recover the sequences in practice, we rely on 
the separation idea advocated in [8]: we first determine the 
support set, namely the active generators. This can be done 
by solving a finite dimensional optimization problem under the 
condition that 3>z,(w) (or Tl(u)) are fixed in frequency up to 
a possible frequency-dependent normalization sequence. Re- 
covery is then obtained by applying results regarding infinite 
measurement vector (IMV) models to our problem [8]. When 
&l(qj) does not satisfy this constraint, we can still convert the 
problem to a finite dimensional optimization problem as long 
as the sequences ak[n] are rich [10]. This implies that every 
finite set of vectors share the same frequency support. As our 
focus here is not on the sparse setting, we do not describe 
here in detail how recovery is obtained. The interested reader 
is referred to [8], [9], [10] for more details. 

The main point we want to stress here is that the ideas 
developed in this paper can also be used to treat the scenario 
of recovering a sparse SI signal from its lowpass content. 
The difference is that now we can relax the requirement for 
invertibility of ^ l(lo) : T l(lo) . Instead, it is enough that these 
matrices satisfy the known conditions from the compressed 
sensing literature. This in turn allows in general reduction 
of the LPF bandwidth, or the number of modulators, in 
comparison with the non-sparse scenario. 

VIII. Conclusions and Open Problems 

This paper studied the possibility of recovering signals in SI 
spaces from their low frequency components. We developed 
necessary conditions on the minimal bandwidth of the LPF 
and sufficient conditions on the generators of the SI space 
such that recovery is possible. We also showed that proper 
pre-processing may facilitate the recovery, and allow to reduce 
the necessary bandwidth of the LPF. Finally, we discussed how 
these ideas can be used to recover sparse SI signals from the 
output of a LPF. 

An important open problem we leave to future work is 
the characterization of the class of generators for which the 
proposed pre-processing scheme can (or cannot) be applied. 
To this end, the following question has to be answered. We 
formulate it only for the most simple case of one generator 
(cf. also the discussion in Example 0J. 

Problem 1: Let (f> E L 2 be an arbitrary function with 
Fourier transform qb and whose Grammian satisfies (01 . 
Consider the shift-invariant space spanned by </>, i.e. 

<%(<£) = span {S k ^4> : k S zj . 

For which functions <fi 6 L 2 does there exist a function 7 6 
S(4>) such that 7 (w) ^ for all lu E [— ir/T, tt/T]. 

The interesting case is when every function cf>(uj — k 2tt/T), 
k E Z has at least one zero in the interval [— ir/T, tt/T]. Then 
the question is whether in this case it is still possible to find 
a linear combination of these functions which has no zero in 
[-tt/T, tt/T]. 
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